Efficient and Less Centralized Federated Learning
نویسندگان
چکیده
With the rapid growth in mobile computing, massive amounts of data and computing resources are now located at edge. To this end, Federated learning (FL) is becoming a widely adopted distributed machine (ML) paradigm, which aims to harness expanding skewed locally order develop rich informative models. In centralized FL, collection devices collaboratively solve ML task under coordination central server. However, existing FL frameworks make an over-simplistic assumption about network connectivity ignore communication bandwidth different links network. paper, we present study novel algorithm, mostly collaborate with other pairwise manner. Our nonparametric approach able exploit topology reduce bottlenecks. We evaluate our on various benchmarks demonstrate that method achieves 10\(\times \) better efficiency around 8% increase accuracy compared approach.
منابع مشابه
Entity Resolution and Federated Learning get a Federated Resolution
Consider two data providers, each maintaining records of different feature sets about common entities. They aim to learn a linear model over the whole set of features. This problem of federated learning over vertically partitioned data includes a crucial upstream issue: entity resolution, i.e. finding the correspondence between the rows of the datasets. It is well known that entity resolution, ...
متن کاملFederated Multi-Task Learning
Federated learning poses new statistical and systems challenges in training machinelearning models over distributed networks of devices. In this work, we show thatmulti-task learning is naturally suited to handle the statistical challenges of thissetting, and propose a novel systems-aware optimization method, MOCHA, that isrobust to practical systems issues. Our method and theor...
متن کاملIs Internet traffic becoming less centralized over time?
Many worries about “network neutrality” are really worries about centralized control of the shared resource that is the Internet. If Internet traffic were decentralizing over time, then these worries should dissipate all on their own, without the need for any technological or political change. Computer scientists can aid this discussion by providing data. If one company could control 99% of Int...
متن کاملFederated Meta-Learning for Recommendation
Recommender systems have been widely studied from the machine learning perspective, where it is crucial to share information among users while preserving user privacy. In this work, we present a federated meta-learning framework for recommendation in which user information is shared at the level of algorithm, instead of model or data adopted in previous approaches. In this framework, user-speci...
متن کاملTechnically Efficient Targets for the Groups by Using the Centralized Scenario and Enhanced Russell Measure
Cooper et al. [Efficiency aggregation with enhanced Russell measures in data envelopment analysis, Socio-Economic Planning Sciences, 41 (2007) 1–21] presented a method for measuring aggregate efficiency, using the enhanced Russell measure. In that paper, they posed questions and opened the way for new opportunities for studying and extending the proposed method and some other related fields. On...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Lecture Notes in Computer Science
سال: 2021
ISSN: ['1611-3349', '0302-9743']
DOI: https://doi.org/10.1007/978-3-030-86486-6_47